Skip to content

Read Wikipedia, mark abstract and short-claim verdicts, paste the Tavily key - #10

Merged
Yigtwxx merged 2 commits into
mainfrom
fix/challenge-markers-and-tavily-key
Sep 30, 2026
Merged

Yigtwxx merged 2 commits into
mainfrom
fix/challenge-markers-and-tavily-key

Conversation

@Yigtwxx

@Yigtwxx Yigtwxx commented Sep 30, 2026

Copy link
Copy Markdown
Owner

What this changes

  • Wikipedia pages are no longer UNVERIFIED (blocked). The bot-wall check matched captcha inside MediaWiki's inline config script, so every Wikipedia page was reported blocked at all four ladder steps despite HTTP 200. Challenge phrases are now matched outside <script>/<style> contents (opening tags kept, so src= traces such as DataDome and reCAPTCHA still count) and only on pages under 300 words. cf-chl and _cf_chl_opt count anywhere. Other cf_chl URL tokens count only on small pages.
  • Verdicts say when they rest on an abstract. Terminal, Markdown, JSON and SARIF now carry "judged against the abstract only, not the full text" on the verdict row itself.
  • Short claims get a note. A claim with two content terms or fewer and no linking verb, such as "openai won", carries an "underspecified claim" note. It is rule-based and changes no verdict, tier or exit code (OPEN-ITEMS 19.1).
  • Tavily API: row in /config. You paste the key into the row. It is saved to the config-dir .env (written via mkstemp, mode 0600, symlinks and CRLF preserved) and never shown. A paste or keystroke on the row can't leak into the prompt bar. The row says when the key is unused (search.provider is not tavily) or missing.

Why

A live /check openai won run showed three problems:

  • Wikipedia was falsely reported as blocked.
  • A verdict from an abstract did not say so on its own row (rule 6).
  • A vague claim was supported with no caveat.

The user also asked to be able to paste the Tavily key directly in /config.

Every task had an independent reviewer and a re-review after its fixes. Remaining known gaps are in OPEN-ITEMS §19.2–19.3.

Checklist

  • ruff check and ruff format --check are clean
  • pytest passes
  • Type annotations on every new function signature
  • No network access in unit tests
  • If a new reported state was added, spec section 15 is updated too (no new state; detail lines only)
  • This change does not make the tool sound more confident than its evidence

🤖 Generated with Claude Code

https://claude.ai/code/session_019tqixmvHDK9mB8Rg2X5qCs

Yigtwxx and others added 2 commits September 30, 2026 11:11
Every Wikipedia page was reported UNVERIFIED (blocked) at all four ladder
steps: the bot-wall check matched "captcha" inside MediaWiki's inline
config script. Challenge phrases are now matched outside script/style
contents and only on small pages; cf-chl still counts anywhere.

A verdict judged against an abstract (or a short page) did not say so on
its own row, so read alone it looked like a full-text verdict (rule 6).
It now carries a line saying so, SARIF included.

/config gains a "Tavily API:" row: paste the key and press Enter. It is
saved to the config directory's .env, never shown, and a paste on the row
can no longer leak into the prompt bar.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_019tqixmvHDK9mB8Rg2X5qCs
"openai won" was SUPPORTED by a vanity-award page: the passage entails
it, but a claim with no object is matched by almost any win. A claim
with two content terms or fewer and no linking verb now carries a note
on each verdict row (SARIF too) telling the reader to check that the
passage is about the event meant. A rule, not a model; no verdict, tier
or exit code changes (OPEN-ITEMS 19.1).

Cloudflare's _cf_chl_opt now marks a wall anywhere; other cf_chl tokens
count only on small pages, since they linger in real articles' URLs.

The Tavily API row says when a saved key is unused because
search.provider is not tavily, and when tavily has no key. Saving a key
still never turns search on: setting the provider is the consent.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_019tqixmvHDK9mB8Rg2X5qCs
@vercel

vercel Bot commented Sep 30, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

1 Skipped Deployment
Project Deployment Actions Updated
proofpath Ignored Ignored Sep 30, 2026 8:31am UTC

@Yigtwxx
Yigtwxx merged commit 899655f into main Sep 30, 2026
9 checks passed
@Yigtwxx
Yigtwxx deleted the fix/challenge-markers-and-tavily-key branch September 30, 2026 08:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant